Process Evaluation of the Realising Ambition Programme

Launched in May 2012 by the Big Lottery Fund (hereafter 'the Fund'), the Realising Ambition programme aims to help more young people aged 8-14 fulfil their potential and avoid pathways into offending. It does this by supporting 25 organisations to replicate proven youth interventions at new sites across the UK. The Realising Ambition process evaluation covered the first three, of five, years of the programme (2012-2015). The process evaluation had two key objectives:* To gain an understanding of the practical issues associated with replication, including issues emerging for organisations involved in replication themselves.* To explore what does and doesn't work when supporting organisations to replicate proven models, and the resources required to support different approaches to replication

Smart Metering Early Learning Project: Synthesis Report

Smart electricity and gas meters with the offer of an in-home display are due to be rolled out to all households in Great Britain by the end of 2020. DECC commissioned this synthesis research as part of its work to support a successful smart metering implementation programme (the Programme), to offer an initial analysis of progress to date and to learn how householders can best be engaged in order to benefit from the roll-out, in particular by saving energy. This report summarises and analyses evidence from a range of sources, including three new DECC research projects into how GB householders engage with smart metering, GB and international evidence on smart metering and energy feedback, and evidence from public health behaviour change programmes

The patient, the practitioner and the organisation : a cultural analysis of complementary therapies in primary care

EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Testing Contribution Claims with Bayesian Updating - CECAN Evaluation and Policy Practice Note (EPPN) No. 2.1 for policy analysts and evaluators

This is an Evaluation Policy and Practice Note that considers testing contribution claims with Bayesian updating in complex policy evaluation

Building a system-based Theory of Change using Participatory Systems Mapping

Theory of Change diagrams are commonly used within evaluation. Due to their popularity and flexibility, Theories of Change can vary greatly, from the nuanced and nested, through to simplified and linear. We present a methodology for building genuinely holistic, complexity-appropriate, system-based Theory of Change diagrams, using Participatory Systems Mapping as a starting point. Participatory System Maps provide a general-purpose resource that can be used in many ways; however, knowing how to turn their complex view of a system into something actionable for evaluation purposes is difficult. The methodology outlined in this article gives this starting point and plots a path through from systems mapping to a Theory of Change evaluators can use. It allows evaluators to develop practical Theories of Change that take into account feedbacks, wider context and potential negative or unexpected outcomes. We use the example of the energy trilemma map presented elsewhere in this special issue to demonstrate

Policy evaluation for a complex world: Practical methods and reflections from the UK Centre for the Evaluation of Complexity across the Nexus

The value of complexity science and related approaches in policy evaluation have been widely discussed over the last 20 years, not least in this journal. We are now at a crossroads; this Special Issue argues that the use of complexity science in evaluation could deepen and broaden rendering evaluations more practical and rigorous. The risk is that the drive to better evaluate policies from a complexity perspective could falter. This special issue is the culmination of 4 years’ work at this crossroads in the UK Centre for the Evaluation of Complexity Across the Nexus. It includes two papers which consider the cultural and organisational operating context for the use of complexity in evaluation and four methodological papers on developments and applications. Together, with a strong input from practitioners, these papers aim to make complexity actionable and expand the use of complexity ideas in evaluation and policy practice

CECAN Evaluation and Policy Practice Note (EPPN) for policy analysts and evaluators - Complexity and what it means for policy design, implementation and evaluation

This briefing explains what complexity science and systems thinking means for people developing and delivering policy. It also introduces a common language and set of symbols to help frame thinking, conversations and action on complexity

The visual representation of complexity: Definitions, examples & learning points

Sustainability practitioners have long relied on images to display relationships in complex adaptive systems on various scales and across different domains. These images facilitate communication, learning, collaboration and evaluation as they contribute to shared understanding of systemic processes. This research addresses the need for images that are widely understood across different fields and sectors for researchers, policy makers, design practitioners and evaluators with varying degrees of familiarity with the complexity sciences. The research identifies, defines and illustrates 16 key features of complex systems and contributes to an evolving visual language of complexity. Ultimately the work supports learning as a basis for informed decision-making at CECAN (Centre for the Evalutation of Complexity Across the Nexus) and other communities engaged with the an alysis of complex problems. A research process was designed to identify sixteen key characteristics of complexity and to inform the development of new images and descriptions. In order to gather ideas from academics, sustainability practitioners and designers with expertise in the complexity sciences, systems mapping and design, I collected 50 surveys at The Environment, Economy, Democracy: Flourishing Together RSD6 (Relating Systems Thinking and Design) conference in Oslo (October 2017) and ran two participatory workshop in London (November and December 2017). The images, definitions, examples and learning points were developed with this research process